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Probabilistic prediction in scale-free networks: Diameter changes 
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In complex systems, responses to small perturbations are too diverse to predict how much they would be 
definitely, and then such diverse responses can be predicted in a probabilistic way. Here we study such a problem 
in scale-free networks, for example, the diameter changes by the deletion of a single vertex for various in silico 
and real world scale-free networks. We find that the diameter changes are indeed diverse and their distribution 
exhibits an algebraic decay with an exponent ^ asymptotically. Interestingly, the exponent ^ is robust as ~ 
2.2(1) for most scale-free networks, insensitive to the degree exponents y as long as 2 < y < 3. However, there 
is another type with ~ 1.7(1) and its examples include the Internet and its related in silico model. 
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PACS numbers: 89.70.+C, 89.75.-k, 05.10.-a 

A complex system consists of many constituents, generat- 
ing emerging behaviors through diverse interactions ^J- 
One of the powerful ways of examining the intrinsic nature 
of a complex system is to observe how such emerging pat- 
terns change by small perturbation applied to the system. In 
complex systems, such a change or response is so sensitive 
to the details of the perturbation that it is extremely diverse. 
In such a case, it is not adequate to predict how much the 
change would be definitely. Recently, Parisi has argued (sl 
that the prediction for the responses to small perturbations 
in complex systems can be made in a probabilistic way. He 
showed examples of protein structures in biological systems 
and spin glasses in physical systems. In case of proteins, sub- 
ject to small external perturbations such as the change in pH 
or the substitution of a single amino acid, they would fold to 
a completely different 3D structure but with practically the 
same free energy. In case of the disordered magnetic sys- 
tems, each spin responds to a slowly varying external field 
by changing its orientation, forming a series of bursts, known 
as Barkhausen noise |4|. The number of spins burst depends 
on the disorder strength of the system, following a power-law 
distribution at a critical strength of disorder. The prediction of 
the number of spins burst in this case can only be probabilis- 
tic. The stock market is another example of complex systems. 
Stock prices are determined as a result of the complicated in- 
terplay between numerous investors, and the price changes 
were also found to exhibit a power-law distribution IsJ. All 
these examples aptly illustrate how the concept of probabilis- 
tic prediction may apply as a new paradigm in modern sci- 
ence. Other examples can also be found in as diverse fields as 
the meteorology and the geology 

Recently, there are many works to describe complex sys- 
tems in terms of graphs |7l|8|, where vertices represent con- 
stituents and edges interactions between constituents. An in- 
teresting feature emerging in such complex networks is the 
emergence of a power-law behavior in the degree distribution, 
^'d(^) ~ ^ f^, where the degree k is the number of edges in- 
cident upon a given vertex. Such complex networks are called 
scale-free (SF) networks. 

In this Letter, we study how SF networks respond to small 



perturbations and check if the concept of probabilistic pre- 
diction can be applied. For this purpose, we investigate a 
simple problem of diameter change when a single vertex is 
removed from the system. Diameter, defined as the average 
distance between every pair of vertices in a network, is a sim- 
ple yet fundamental quantity of SF networks to characterize 
the small-world nature, and can be thought of as a measure 
reflecting the efficiency of a network. Our main interest is 
how much the efficiency of a network would be affected by 
the removal of a single vertex. When a vertex is removed, 
each pair of remaining vertices whose shortest pathway had 
passed through the removed vertex should find detours, re- 
sulting in the rearrangement of shortest pathways over the net- 
work. Thus the diameter change occurs in a collective manner. 
From the extensive numerical calculations for a number of SF 
network models and real-world examples, we find that the di- 
ameter changes indeed are very diverse and crucially depend 
on the degree of the removed vertex. When a vertex with a 
few number of connections is removed, the diameter changes 
little. However, when a vertex with a large number of connec- 
tions is removed, the diameter change is drastic, exhibiting a 
power-law distribution with an exponent ^, 



Pc(A)-A-? 



(1) 



for large A, where A is the dimensionless relative diameter 
change defined as the diameter change caused by the removal 
of a certain vertex divided by the original diameter before the 
removal, and (A) is its distribution. Moreover the exponent 
^ turns out to be robust for various SF networks, insensitive 
to the degree exponent 7 for 2 < 7 < 3. 

To be specific, we consider a undirected SF network with 
finite number of vertices A' and measure the diameter of the 
network. Note that we limit our interest to undirected net- 
works only in this work. Next we remove a certain vertex / 
and measure the diameter di of the rest of the network. Mea- 
suring a dimensionless quantity. A,- — [di — do) /do for all /, 
where do is the diameter of the original unperturbed network, 
we obtain the distribution of A for the network. Note that our 
case is different from the previous study of the robustness of 
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FIG. 1 : Normalized histogram of tiie diameter changes for the static 
model with 7=3 and N = lO'*, averaged over 10 configurations. 
Horizontal range is truncated for clearance, but runs up to 2 x 10^^. 
Inset: Plot of Pc (A) in log-log scale for A > 0. Dashed line is a fit 
line having a slope —2.2. Data points are logarithmically binned. 



SF networks where vertices are removed successively. 

In our case, on the other hand, only a single vertex is removed 
each time. When a certain vertex is removed, the network 
may disintegrate into more than one cluster. In such cases, dj 
is calculated only within the largest cluster. The diameter can 
be measured via a simple breadth-first search algorithm. To 
obtain the distribution of the diameter changes, we need the 
computation time of order (N^ ) . 

To look into more details, we consider the static model fl^ . 
It is constructed by connecting niN pairs of vertices / and j 
with probability proportional to (/j)^", where is the vertex 
number and a is a parameter. We use m = 2. Its degree dis- 
tribution follows a power law, Pci{k) k^^ with j— 1 + 1/a. 
Thus, tuning the parameter a in [0, 1), we obtain a continuous 
spectrum of the exponent y in the range 2 < 7 < oo. 

The diameter change A, by the removal of a certain vertex / 
in such SF networks can be positive or negative, and the his- 
togram of the diameter changes is highly centralized around 
A = (Fig. 1). However, it exhibits a fat tail for A > (the 
inset of Fig. 1). For the static model with 7=3, for example, 
the case of small diameter changes in the range | A| < 2 x 10^^ 
occurs with frequency as high as 96%. Thus the effect of a 
vertex removal usually is negligible as a whole, which is man- 
ifested by the exponentially bounded fluctuations of the diam- 
eter around its original value. We estimate the A^-dependence 
of such small diameter changes in a mean-field-type approach. 
It is known that the diameter cIq depends on the number of ver- 
tices as c/q ^ \nN for random graph and do ^ \nN /\n\nN [T^ 
for the Barabasi- Albert model |9] with 7=3. When a vertex 
is removed, the diameter may be reduced as d ^\vi{N — I) 
oxd^\n[N-\ )/lnln(A^ - 1 ), both leading to A « - 1 /N\nN 
for large A?. Thus when = lO'*, A ~ ^(10^^), which IS com- 
parable to numerical values of the central part in Fig. 1 . On 
the other hand, substantial (about 4%) vertices have a serious 
impact on the system's efficiency and they indeed contribute 
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FIG. 2: The diameter change distribution -Pc(A) for the static model 
with 7= 2.2 (□), 2.4 (0), 2.6 (v), 2.8 (A), 3.0 (O), and 4.0 (+), 
and the Erdos-Renyi model (x). The data, obtained for A' = 10"* and 
averaged over 10 configurations. The two data sets (+, x ) are shifted 
vertically for comparison. Dashed line having a slope —2.2 is drawn 
for the eye. Note that the deviations from the straight line at the fat 
tail are due to the generic finite-size effects for the SF networks with 
7< 3 \M- 



to the positive tail of the histogram, showing the power-law 
behavior, Eq. Q. We find that such large diameter changes 
are mainly due to the removal of a vertex with large degree. 
This feature is reminiscent of the percolation problems on the 
SF networks Il4ll5ll . 

Let us investigate the power-law behavior for large A in de- 
tails. The exponent ^ seems to be robust as 1^ w 2.2(1) as long 
as 2 < 7 < 3 for the static model as shown in Fig. 2. Similar 
behaviors are found in other model networks (ii)-(vii) listed 
in Table 1 . These include the SF networks showing nontrivial 
degree-degree correlations |26]. For 7 > 3, on the other hand, 
as 7 increases, the power-law behavior sets in only for larger 
values of A and the exponent ^ increases with 7. Eventually 
the diameter change distribution for the Erdos-Renyi random 
networks decays exponentially as shown in Fig. 2. 

To see such universal behavior of ^ in real world, we con- 
sider a couple of real-world networks, the protein interaction 
networks (PIN) and the Internet. For the PIN of the yeast 
Sacchawmyces cerevisiae |22], we also find a power law in 
the diameter change distribution with an exponent ^ « 2.3(1) 
(Fig. 3), consistent with the one obtained for various model 
networks, including the one proposed as its own in silico 
model (vii) |21]. For the Internet at the autonomous systems 
level 1 23 1, the diameter change distribution again follows a 
power law, however, with a different exponent ^ w 1-7(1) 
(Fig. 4). The smaller exponent C, indicates that the effect of 
the removal of vertices contributing to the tail of the distribu- 
tion is much more severe than the previous cases with ^ « 2.2 
[(i)-(viii) in Table 1]. To confirm the novel value of C, for 
the Internet, we perform the same calculations for its in silico 
model, called the adaptation model |24), and indeed obtain 
1^ w 1.7 for it, too. The two different behaviors of the diam- 
eter change distribution are rooted from distinct topological 
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TABLE I: Summary of the results for various SF networks. Tabulated for each network are the system size the mean degree (k), the degree 
exponent y, the diameter change exponent ^, and the betweenness centrality exponent rj |25]. 





System 


A' 


{k) 


r 




J? 


ref. 


(i) 


Static model 


104 


4 


2.2-3.0 


2.2(1) 


2.2(1) 


[12] 


(ii) 


Barabasi- Albert model 


10-* 


4 


2.2-3.0 


2.2(1) 


2.2(1) 


[9] 


(iii) 


Copying model 


104 


4 


2.2-3.0 


2.2(1) 


2.2(1) 


[17] 


(iv) 


Fitness model 


10^ 


4 


2.25 


2.2(1) 


2.2(1) 




(V) 


Accelerated-growth model 


10^ 




3.0(1) 


2.2(1) 


2.2(1) 




(vi) 


Huberman-Adamic model 


104 




3.0(1) 


2.2(1) 


2.2(1) 


[20] 


(vii) 


Protein interaction network model 


104 


ff(i) 




2.2(1) 


2.2(1) 


[21] 


(viii) 


Protein interaction network of the yeast S. cerevisiae 


5662 


6.1 


3.2(2) 


2.3(1) 


2.3(1) 


[22] 


(ix) 


Internet at the autonomous systems level 


6474, 12058 




2.1(1) 


1.7(1) 


2.0(1) 


[23] 


(X) 


Adaptation model 


~6500 




2.1 


1.7(1) 


2.0(1) 


[24] 



features of shortest pathways of each case, which will be dis- 
cussed later. 

Recently, it was proposed that the SF networks with 2 < 
7 < 3 can be classified into two classes 1 12, 25], following the 
power-law behavior of the betweenness centrality (BC) distri- 
bution j27iE^ . The BC gk of a vertex k is the accumulated 
sum of the fraction of shortest pathways passing through k 
and its distribution follows a power law, Pg{g) ^ g^^ for SF 
networks. The BC exponent r\ turns out to be robust as ei- 
ther T] ~ 2.2(1) (class I) or Tj « 2.0(1) (class II) as long as 
2 < 7< 3 I12il25ll . Interestingly, the networks (i)-(viii) in Ta- 
ble 1 having the diameter change exponent ^ « 2.2 belong to 
the class I, and the values of C, and r\ coincide with each other 
within our numerical resolutions, while they are different for 
the class II. Empirically, the rank of a vertex in g and that in 
A are Ukely to be the same for vertices with large degrees. If 



then, the relation Pg{g)dg ~ Pc{A)dA would hold asymptoti- 
cally, leading to 

A(^)^^(''-i)/(?-i), (2) 

for large g. This type of relation also holds between de- 
gree and BC 1 12]. Indeed, the slopes in the double logarith- 
mic scale in the upper insets of Figs. 3 and 4 are 1.1(1) for 
the PIN and 1.4(1) for the Internet, respectively, consistent 
with the predictions from the formula, Eq. (2). Thus the two 
classes, the classes I and II, are also categorized by the diam- 
eter change distribution and the distinction between them can 
be observed more clearly through it. 

Our finding that the diameter change distribution is also 
classified into the classes I and II following those for BC dis- 
tribution may be rooted from the fact that both quantities, di- 
ameter and BC, depend on universal features of the shortest 
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FIG. 3: The diameter change distribution Pc{A) for the PIN of the 
yeast 5. cerevisiae. The slope of the fit line (dashed) is —2.3, drawn 
for the eye. Upper inset: Plot of A(g) vs. g. The slope of the straight 
line is 1.1, drawn for the eye. Lower inset: The largest-cluster-size 
change distribution P^(8S). Here dS is normalized by N. The slope 
of the fit line is —3.0, drawn for the eye. 



FIG. 4: The diameter change distribution /'c(A) for the Internet at the 
autonomous system level. The slope of the fit line (dashed) is —1.7, 
drawn for the eye. Upper inset: Plot of A(g) vs. g. The slope of 
the straight line is 1 .4, drawn for the eye. Lower inset: The largest- 
cluster-size change distribution Ps{SS). Here SS is normalized by A'. 
The slope of the fit line is —2.4, drawn for the eye. 
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pathways topology between a vertex pair in networks. When 
the sum rule |29], i.e., Y.k8k ^ d is applied, one can see im- 
mediately that the diameter change distribution is the same as 
the total BC change distribution. On the other hand, the net- 
works belonging to the class II are more sparse and ramified 
than those in the class I, so that the Internet is more fragile 
by the removal of a single vertex than the PIN. We compare 
the distribution of the size change 5S of the largest cluster 
for the PIN and the Internet by a single vertex removal. As 
shown in the lower insets of Figs. 3 and 4, the giant cluster in 
the Internet becomes much smaller than in the PIN. Thus the 
number of vertex pairs connected after the removal becomes 
much smaller in the Internet than in the PIN. Consequently, 
the difference of the exponent between the two classes ap- 
pears much larger than that of the exponent rj in the class II. 
However, it is not clear how the power-law behavior in Pc{A) 
arises and what determines its exponent. 

It would be interesting to generalize our study to the case 
of having more than one vertex removed. For simplicity, we 
consider the case of two-vertex removal, in particular, one is 
the hub and the other is an arbitrary vertex. Interestingly we 
find that the diameter change distribution also exhibits a fat- 
tail behavior with the same exponent ^. We cannot check if 
the fat-tail behavior still holds for more general cases due to 
huge amount of computing time. Meanwhile, it has been stud- 
ied that SF network is robust against random failures. To show 
this, the diameter change due to removal of a finite fraction of 
vertices was measured by taking average over a few samples, 
not over the whole ensemble. If the diameter change distri- 
bution after those removals still possesses a power law distri- 
bution with 1^ < 3, as is the case here, then we could say that 
the average diameter change cannot reflect its intrinsic nature 
because its variance diverges. Thus the diameter changes af- 
ter random failures should also be described in a probabiUstic 
way. 

In summary, we have studied the diverse behavior in re- 
sponse to a small perturbation, a deletion of a single vertex in 
SF networks. The diameter change A by a removal of a ver- 
tex is very diverse, exhibiting a power-law distribution with 
an exponent ^ for large A. Moreover, the diameter change 
exponent ^ is robust as ^ ~ 2.2 for most SF networks with 
2 < 7 < 3, or ^ ~ 1 .7 for the Internet as an exception. 

This work is supported by the KOSEF Grant No. R14- 
2002-059-01000-0 in the ABRL program. 
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